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ABSTRACT 

A classroom observation instrument was developed for 
investigating teacher and student behaviors associated with the 
maintenance of an inquiry atmosphere where Earth Science Curriculum 
Project materials are used as a course of study. This instrument was 
later used in ESCP classrooms to determine its reliability and 
usefulness in describing teacher and student philosophy and 
objectives. Teacher and student behaviors were grouped into four 
major categories consistent with situations expected to occur in ESCP 
classes, i.ei , developing text materials, pre-laboratory, laboratory, 
and post-laboratory discussion. Seven judges, selected from a list of 
ESCP writers and trial teachers, were asked to rate each item as (1) 
consistent with ESCP, (2) neutral, or (3) inconsistent with ESCP. 
Classroom observations based on the instrument developed for this 
study were made of six ninth-grade ESCP teachers in three junior high 
schools. The results of the study were analyzed to describe teachers 
relative to ESCP and to develop ideas for future research. (BR) 
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THE DEVELOFHENT OF A CIASSROOM OBSERVATION INSTRUMENT 
RELEVANT TO THE EARTH SCIENCE CURRICULUM PROJECT 

John P. Smith 
University of Washington 

INTRODUCTION 

Beginning with the work of the Physical Science Study Committee 
(PSSC) in 1956, the science reform movement of the past decade has 
resulted in a nund>er of new secondary school curricula which 
have become familiar in many classrooms across the nation. The 
teaching-materials packages developed by the various curriculum 
committees are characterized (I) an organization of content 
(or as in BSCS three different organizational emphases) broadly 
representative of the structure -of the discipline as seen by the 
research scientist, (2) new goals and objectives including 
processes of science as well as current scientific knowledge, 
and (3) suggested methods of instruction consistent with the 
inquiry aspects of the respective scientific disciplines. 

RATICmLE 

Designers of the experimental science curricula contend that 
the method of instruction employed by a teacher, e.g., the inquiry 
approach, contributes significantly to what is learned. The 
result has been the development of science curricula demanding 
special ways of teaching to achieve their respective goals. As 
the new curricula grow in number, the need for studies describing 
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the teacher's b^avior in implementing a new curriculum becomes 
apparent. Previous models for curriculum evaluation have not 
provided the answers. The practice of comparing student achieve- 
ment in an experimental science curriculum with student achieve- 
ment in a traditional science course does not identify the classroom 
conditions under '^hich an experimental curriculum does or does 
not achieve its objectives. 

Hilgard^ stated there is a need for research investigating 
the teacher's "strategy of innovation" in implementing a new 
curriculum. He was concerned that in the process of innovation 
teachers not party to the experimental tryouts of a new curriculum 
may fail to use equipment and available resources or to adequately 
interpret suggested teaching styles. 

Classroom observations support Hilgard's concerns. After 
visiting classes where the new physics was taught with an 
inappropriate empl^sis on the presentation and memorization of 
facts, Tyier^ concluded that there is a need for studies describing 
what occurs in classrooms where experimental curricula are used. 
^®Ha's visits to classrooms where nationally developed science 
curricula were taught resulted in observations similar to 
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Tyler's. Pella found that course work still focused on memori- 
zation of facts with little attention to concept development— a 
major goal of the recently developed science curricula. 
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PROBLEM 

The purpose of this investigation was to develop an observa- 
tion instrument for collecting data on teaching perfoncances 
under carefully specified conditions involving the teacher, a 
new science curriculum, and students. The Earth Science 
Curriculum Project (ESCP) was selected for the study as repre- 
sentative of a course planned by a national curriculum committee. 

Development of the Observation Instrument 
The first step in the development of the observation 
instrument was to review journal articles describing ESCP; 

ESCP Wewslerrers; the £Sup Tea^Ser ^sHGuide-Investigat^^^^ the Earth . 
Parts I and II; and the ESCP text — Investigating the Earth . The 
purpose of the review was two fold : (1) to identify statements 

suggesting specific teacher and student behavior expected as 
part of the ESCP approach; and (2) to identify assertions having 
important implications for teaching ESCP but not expressed in 
terms of teacher and student behavior. The frequent reference 
to teaching ESCP as inquiry fell into this latter category. 

Since inquiry as behavior is not well defined, works by Beveridge^ 
on the art of discovery and Schwab^ on inquiry were reviewed 
for the purpose of identifying the scope of inquiry in science. 
Using the inquiry theme as the major focus in developing the 
ESCP observation instrument, a list was compiled of statements 
relevant to inquiry. As a guide for selecting inquiry relevant 
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statements. Inquiry vas defined as that behavior requiring or 
demonstrating student involvement %fith selected earth science 
problems either in class discussions or in student investigations. 

To obtain classroom examples of inquiry behavior, observations 
and audiotapes mere made of two ESCP classes during the 1968 
summer school session. One teacher observed vas a geology major 
with experience as a trial teacher of ESCP. The other teacher, 
a biology major, had attended an ESCP institute and had one year 
of ESCP teaching e3q>erience. It was felt that the behavior 
observed would be representative of kinds one might hope teachers 
and students would demonstrate during the regular school year. 

The inquiry relevant statements obtained from the review 
of the ESCP literature described above and examples of teacher 
and student behavior from observer notes and tapes of ESCP 
classes were used as a basis for writing behavior items for 
inclusion in the observation instrument. 

Each item was viewed as a potential indicator of one of 
two categories of behavior: (1) behavior consistent with 

maintaining the inquiry atmosphere of the ESCP approach and 
(2) behavior incompatible with the ESCP inquiry approach. 

Behavior descriptions were written to make assignment to one of 
the categories as unambiguous as possible. Teacher and student 
behavior were grouped into four categories consistent with 
situations expected to occur in ESCP classes, i.e., developing 
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text oaterial, pre- laboratory, laboratory, and post-laboratory 
discussion. 

The preliminary list of 107 items was evaluated by six 
judges selected from the list of ESCP writers and trial teachers 
found in the ESCP Teacher *s Guide . Part These judges were 
asked to rate each item on a three point scale as either (1) 
consistent with ESCP, (2) neutral, or (3) inconsistent with 
ESCP. A median value and interquartile range was computed for 
the judges* ratings of each item. An item was not retained if 
its interquartile range (IR « - Q^) was greater than that of 

51% of the items with the same median or if its interquartile 
range was equal to or greater than could be obtained by chance. 

Ninety-one items representing behavior consistent with, 
neutral to, and inconsistent with ESCP were retained from the 
original list of 107 items. (One item was added by the author to 
obtain desired information about post- laboratory discussions.) 

Items were placed in subcategories within the categories of 
developing text material, pre- laboratory, laboratory, and post- 
laboratory discussion.* The final form of the observation 
instrument is shown in Appendix A. Items appearing in the 
instrument have been condensed by reducing words to distinctive 
letters and by eliminating all but "key" words. For example, 

*For a complete description of the ESCP observation instrument 
please write to the author. College of Education, University of 
Washington, Seattle, Washington 98105. 
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item AI, "Teacher distinguishes between fact and theory" appears 
on the instrument as "T dst btw fact & thry." 

PROCEDURE 

Classroom observations using the instrument developed for 
this investigation were made during Spring, 1969, of six 9th 
grade ESCP teachers in three junior high schools near Stanford 
University. Teachers were assigned to either the Training Group 
or the Study Group . 

Teacher Characteristics 

Four of the six teachers observed were in their second year 
of teaching ESCP. The remaining two were teaching ESCP for the 
first time. All but one teacher had attended a local ESCP 
workshop or ESCP institute prior to teaching the course. (See 
Table I for a summary of teacher background.) 
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TABLE I 

Sucnnary of Teacher Background 



Teacher 


Number of 
years ESCP 
escperience 


Training in 
ESCP methods 
prior to 
teaching ESCP 


Undergraduate 

major 


Earth Science 
units (semester) 


A 


2 


Local ESCP 
Workshop 


Chemistry 


9 


B 


1 

semester 


Local ESCP 
Workshop 


Biology 


4 


C 


2 


Local ESCP 
Workshop 


Biology 


0 


D 


2 


Local ESCP 


Biology 


11 






Workshop 






£ 


1 

semester 


None 


Biology & 
Chemistry 


3 


F 


2 


ESCP 

Institute 


Biology 


20 



Student and Classroom Characteristic 
In each of the three junior high schools, ESC? was required 
of all 9th grade students. The teachers reported that their 
students' abilities ranged from low to high and that students' 
interests were quite varied. Students were not homogeneously 
grouped by class. Classes ranged in size from 25 to 30 students. 
Teachers reported that present classroom facilities and earth 
science investigation kits were, for the most part, adequate for 
teaching ESCP. 
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Observer Characteristics 

Each of the six observers participating in the investigation 
was a graduate student in science education at Stanford University 
and an experienced science teacher although none had ever taught 
or observed ESC? classes before this investigation. Experienced 
science teachers were chosen as observers because of their 
familiarity, in general, with the expected classroom settings, for 
their understanding of science concepts, and for their familiarity 
with the terminology used in the observation instrument. 

Observer T raining 

The training of observers was accomplished in three phases: 

(1) individual study of the behavior items, explanations, and 
examples one week prior to the first formal group training 
session, (2) a group training session with semi-programmed 
observer manual and selected audiotapes of ESCP classes, and 
(3) classroom e:iq>erience using the observation instrument. 

In phase three, obseirvers were assigned to one of three 
teams. Fairings were made on the basis of convenience to the 
observers. Each team observed one of the three ESCP teachers (A, B, & C) 
in the Training Group for one 50 minute period each day for a 
period of eight days. 

During classroom training each observer recorded his obser- 
vations independently of the other member of his team. Immediately 
following each class period observers discussed and resolved 
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discrepancies in their records; however, the records were not 
changed. Because of the difficulty experienced in identifying 
ESCP investigation activities during initial observations (many 
ESCP investigations may be done at the student's desk) each 
observer was allowed to refer to a copy of the ESCP text. 

Investigating the Earth as an aid to identifying laboratory 
settings. 



Inter-Observer Agreement 

Immediately following the training period, the three 

teachers (D, E, & F) and their classes comprising the Study Group 
were observed for one 50 minute period per day for ten consecutive 
days. During this time, observers were rotated among teachers 
and observer teams. The interobserver agreements reported below 
^3sed only on data from observations of the study group. 
Inter-observer agreement for the observation period was deter- 
mined by the formula 

p - number of agreements ^ 

number of agreements + number of disagreements * 

i.e., where P equals percentage agreement. When observations for 
all teachers were pooled across classroom settings, inter- 
observer agreement (two observers at a time) was P * 74%. 

Percentage agreements by classroom setting were: Developing 
Text Material, P = 70%; Pre-Laboratory, P » 87%; Laboratory, 

P “ 75%; and Post-Laboratory Discussion, P « 79%. 

When the frequency with which individual items occurred 
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was ignored, and only observer agreement as to the occurrence 
or non-occurrence of an item considered (each agreement counted 
as one and each disagreement counted as one), then, using the 
same formula as above, over-all inter-observer agreement was 
P = 87X. 



RECOMMENDATIONS FOR RESEARCH 

It is proposed that trained observers using the ESCP observa- 
tion instrument record the behavior of a large sample of ESCP 
teachers for the purpose of making generalizations about "how" 
the Earth Science Curriculum Project is presented in classrooms. 
The investigation of a large sample of ESCP teachers would 
enable the investigator to study the relationship between 
different categories of teacher verbal behavior and student 
behavior and the in^lications observable student behavior have 
for learning concepts, processes, and attitudes. 

RECOMMENDATIONS FOR TEACHER TRAINING 
The identification of teacher behavior relevant to a curricu- 
lum is essential as a basis for describing specific aspects of 
teacher behavior as opposed to the general practice of talking 
about "good" teaching or "bad" teaching. As a device for use 
in teacher training, this instrument is considered useful at 
t\io levels. (1) As a tool in the preservice training of ESCP 
teachers, the instrument identifies behavior consistent with 
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£SCP that could be maximized during preparation for teaching 
ESCP. It also identifies behavior inconsistent with £SCP 
that one vould expect to minimize during teacher training. 

(2) As an instrument for observing teachers where ESCP is 
already an accepted part of the school program, it may be used 
to identify current practices of teachers. 

SlMim 

An instrument has been developed for the identification of 
teacher and student behavior relative to the Earth Science 
Curriculum Project. The en^hasis on behavior enables one to say 
in what ways teacher and student behavior is consistent with the 
intended ESCP approach rather than to say only that teaching is 
"generally" consistent or inconsistent with the intent of ESCP. 
Because it contains descriptions of teacher and student behavior. 
Instrument should be useful in the trai ning of prospective 
and inservlce ESCP teachers and as a basis for investigating 
the teaching behavior of ESCP teachers. The approach used in 
identifying behavior consistent with the ESCP philosophy may also 
be considered as a model of how teachers (either preservice or 
inservice) may better identify what is expected of them when 
adopting a new curriculum. 
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